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Abstract 
The  classical  optimal  growth  model  consists  of  a  concave  production 
function  satisfying  the  Inada  conditions  and  a  concave  utlity  function 
having  infinite  marginal  utility  at  zero.   Under  these  assumptions,  the 
second  order  condition  is  always  satisfied,  hence  consumption  is  a 
unique  interior  solution  with  marginal  consumption  between  zero  and  one, 
In  this  paper  a  nonclassical  optimal  growth  model,  i.e.,  the  production 
function  is  convex  for  small  inputs  and  concave  for  large  inputs,  is 
studied.   It  is  shown,  by  example,  that  a  second  order  condition  is 
needed  to  distinguish  between  maxima  and  minima  and  that  marginal 
consumption  may  be  negative  over  an  interval.   The  second  order 
condition  is  that  marginal  consumption  is  less  than  one.  The  dynamic 
properties  of  the  model  is  also  studied. 


1.   Introduction 

The  classical  optimal  growth  model  consists  of  a  production 
function  which  is  concave  and  satisfies  the  Inada  conditions,  and 
a  concave  utility  function  having  infinite  marginal  utility  at 
zero.   It  is  also  assumed  that  the  planner  maximizes  the  sum  of 
discounted  utilities.   These  assumptions  yield  a  simple  and 
elegant  model  explaining  many  aspects  of  capital  accumulation.   In 
fact  this  model  leads  to  many  intuitive  and  appealing  results.   In 
particular  the  existence  of  a  unique  optimal  consumption  (and  invest- 
ment) function  yields  a  unique,  stable  optimal  growth  path  which, 
independent  of  the  initial  stock  of  capital,  converges  to  the  unique 
steady  state  equilibrium.   Other  properties  are  also  implied  by  this 
model.   For  example,  the  consumption  function,  and  the  investment 
function,  is  always  an  interior  solution  with  marginal  consumption 
positive  and  less  than  one.   Many  more  mathematical  results  are 
also  implied,  and  used  to  generate  the  results  described  above, 
such  as  the  concavity  and  differentiability  of  the  value  function. 
This  leads  also  to  the  fact  that  no  second  order  conditions  are  needed 
or  put  another  way,  the  second  order  conditions  are  already  built 
in  to  the  concavity  assumptions.   Moreover  the  necessary  first 
order  conditions,  i.e.,  the  Euler  equation  and  the  transversality 
condition  are  therefore  also  sufficient. 

While  this  model  is  attractive  in  view  of  the  simplicity 
of  its  assumption  and  the  level  of  generality  of  its  conclusions, 
it  is  accepted  as  a  suitable  approximation  of  economic  reality  only 
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for  economies  at  an  advanced  state  of  development.   In  recent  years, 
attention  has  been  focused  on  what  is  now  known  as  the  non-classical 
optimal  growth  model,  in  which  the  preferences  of  the  planning  authority 
are  still  assumed  to  be  convex,  but  the  production  function  is  convex 
for  small  input  levels  and  concave  for  large  ones.   This  assumption 
is  a  better  approximation  in  economies  which  are  underdeveloped  but 
hope  to  develop  over  time.   Moreover  resource  problems,  which  use 
optimal  growth  models  to  determine  the  optimal  extraction  of  resources, 
are  also  better  described  by  a  convex  initial  portion.   In  the  non- 
classical  model  it  is  still  assumed  that  the  production  function  has 
at  least  one  fixed  point,  although  it  cannot  satisfy  the  Inada  condi- 
tion at  zero  since  it  is  convex  near  the  origin. 

The  model  thus  formulated  is  obviously  a  problem  in  non- 
concave  programming.   While  it  has  been  recognized  in  the  recent 
literature  ([2],  [3],  and  [5])  that  the  first  order  conditions 
may  not  be  sufficient,  no  attempt  was  made  to  devise  a  systematic 
approach  to  such  problems.   Rather,  the  authors  resorted  to  isolated 
arguments,  often  complex  and  sometimes  elegant,  in  trying  to  establish 
additional  characterization  beyond  the  first  order  conditions  for 
optimal  paths.   For  example,  Dechert  and  Nishimura  [2]  used  the 
principle  of  optimality  to  prove  the  monotonicity  property  of  optimal 
paths. 

The  major  contribution  of  this  paper  to  the  study  of  normative 
dynamic  models  is  to  provide  a  simple  unified  approach  to  non-concave 
programming  problems,  through  the  use  (in  addition  to  the  Euler  equation 
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and  the  transversality  condition)  of  a  second-order  condition  for 
optimality.   It  will  be  shown,  using  a  simple  example,  that  this 
second  order  condition  is  actually  needed  to  distinguish  maxima 
of  the  objective  function  from  other  solutions  of  the  Euler  equa- 
tion.  The  method  proposed  to  derive  sufficiency  conditions  in  the 
nonclassical  case  is  applicable  to  any  dynamic  programming  problem. 
However,  the  concise  expression  of  the  second  order  condition 
in  terms  of  the  optimal  consumption  function,  in  our  case,  is 
achieved  only  because  our  objective  function  does  not  depend  on  the 
state  variable  and  because  of  the  semi-linearity  of  the  one  sector 
model. 

The  characterization  of  optimal  paths  in  the  literature  is 
limited  to  the  study  of  the  properties  of  the  (optimal)  value  func- 
tion and  optimal  state  or  investment  functions.   However  omitted  in 
these  studies  are  the  properties  of  the  optimal  consumption  function. 
The  second  order  condition  derived  in  this  paper  reduces  to  the  con- 
dition that  the  marginal  consumption  function  is  uniformly  bounded 
from  above  by  one.   In  the  classical  case  marginal  consumption  being 
less  than  one  is  a  general  result  of  the  model  while  in  the  nonclassi- 
cal case  this  result  is  the  second  order  condition  for  the  maximiza- 
tion.  Another  important  implication  of  the  nonclassical  case  is  that 
the  intuitive  result  that  marginal  consumption  is  positive  does  not 
follow  in  the  nonclassical  model.   In  fact  we  present  an  example  which 
shows  that  marginal  consumption  may  be  negative  over  an  interval,  i.e., 
that  consumption  declines  with  increasing  input  levels  for  an  optimal 
path! 
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Moreover  our  analysis  provides  a  rigorous  mathematical  treat- 
ment of  the  nonclassical  optimal  growth  problem,  in  that  it  establishes 
the  needed  differentiability  properties  of  the  value  function  and  then 
actually  derives  the  Euler  equation  rigorously.   These  differentiability 
properties  turn  out  to  be  significant  in  terms  of  the  induced  continuity 
properties  of  the  optimal  state  function  for  the  steady  state  analysis 
of  optimal  paths. 

Finally,  using  the  second  order  condition  and  the  differ- 
entiability properties  of  the  value  function,  the  convergence  properties 
of  the  optimal  paths  are  studied.   It  is  seen  that,  unlike  the  classi- 
cal case,  two  distinct  cases  are  possible,  depending  on  the  level  of 
interest  rate. 

With  mild  discounting,  all  optimal  paths  converge  to  a  unique 
stable  steady  state  equilibrium  regardless  of  the  initial  capital  level, 
as  in  the  classical  case. 

With  strong  discounting,  there  may  be  zero,  one  or  two  equi- 
libria (not  counting  the  origin) : 

i)   No  equilibria;   The  origin  is  then  a  stable  equilibrium 
to  which  any  optimal  path  converges. 

ii)   One  equilibrium:   It  must  be  stable  and  on  the  concave 
part  of  the  production  function  and  there  is  an  upward  jump  through 
the  45°  line  of  the  graph  of  the  optimal  state  function. 

iii)   Two  equilibria:   One  must  be  stable  and  the  other  unstable. 

For  both  ii)  and  iii)  there  exists  a  critical  level  of 
capital  below  which  it  is  optimal  to  deplete  the  capital,  and 
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above  which  it  is  optimal  to  accumulate  capital  up  to  the  stable 
equilibrium  level. 

2.   The  Model 

With  the  exception  of  the  properties  of  the  production  function 
f,  the  formulation  of  the  problem  in  the  non-classical  optimal  growth 
model  is  precisely  the  same  as  that  for  the  classical  case.   It  is 
assumed  that  the  preferences  of  the  central  planner  are  expressed 
by  a  strictly  concave  utility  function  u  with  the  following  properties: 

PI:   u  e  C2(0,+co) 

P2:   u»  >  0,  u"  <  0 

P3:   lim  u'(c)  =  -H» 
c+0 

The  objective  of  the  planner,  whose  time  rate  of  preference  is  given  by 

a  discount  factor  6  such  that  0  <  5  <  1,  is  to  maximize  the  present 

discounted  value  of  the  utility  of  consumption  over  an  infinite  horizon, 

i.e.  , 

00 

E   6C  u(c  )  . 
t=0 

Here  c  is  consumption  at  time  t. 

At  any  time  t,  aggregate  output  x  may  either  be  consumed 
(c  )  or  invested  (x  -  c  ).  Letting  f  denote  the  aggregate  produc- 
tion function,  then, 


x  -  =  f(xt  -  c  )  ,  t  -  0,  1,  ... 


-6- 

We  assume  that  initially  x_  =  s,  the  properties  of  f  are  (refer  to 
Figure  1) . 

P4:   f  e  c2[0,+~),  ff  >  0 


P5:   There  exists  an  inflection  point  x_  >  0  such 


that:   f"(x)  %   0  if  x  $   x 


P6:   There  exists  a  point  x   >  xT  such  that  f(x  )  =  x 

c    I  c     c 

and  f(x)  <  x  if  x  >  x 

c 

Property  P5  means  that  the  production  function  is  convex  on 
the  interval  [0,x  ]  and  concave  on  the  interval  [x .,+») .   Thus  the 
production  process  exhibits  increasing  returns  to  scale  for  low  input 
levels  and  decreasing  returns  to  scale  for  high  input  levels.   It  is 
straightforward  to  show  for  this  one-sector  production  function  that  the 
average  product  curve  f(x)/x  has  the  traditional  upside  down  U-shape, 
and  crosses  the  marginal  product  curve  f ' (x)  at  the  maximum  average 

product  x    .   Moreover,  the  marginal  product  curve  lies  above  the 

v  max  ° 

average  product  curve  for  stocks  smaller  than  x    and  below  it  for 

&  v  max 

stocks  larger  than  x    (see  Figure  2) .   It  is  always  the  case  that 
&         max 

xT  <  x    <  x  .   Also,  the  region  of  increasing  returns  to  scale  is 
I    max  —  c 

[0,x     and  that  of  decreasing  returns  to  scale  is  [x    ,+») . 
max  max 

The  optimization  problem  is 

oo 

max    I      6l   u(c  )  =  V(s)  (1) 

UJ  t=0 


subject  to    x  1  =  f(xt~ct)  ,  t  =  0,  1,  ...      (2) 

xQ  =  s 
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and, 

0  1   ct  1   xt  .  t   =  °>  l>    •••  (3) 

We  shall  refer  to  a  maximizer  c*  as  an  interior  solution  if 
constraint  (3)  holds  with  strict  inequality,  and  as  a  corner  or  boundary 
solution  if  either  c*  =  x  ,  or  c*  ■  0. 

3.   Optimality  Conditions 

A.   First-order  Conditions 

From  the  properties  of  f ,  it  follows  that  the  value  function 
V  is  bounded  since  for  any  given  s, 

V(s)  c  - — r  u(max{s,x  })  , 
±—  o  C 

By  the  principle  of  optimality: 

V(x)  =  max  M(c;x)  ,  0_<c<_x,x_>0,  (4) 

c 

where 

M(c;x)  =  u(c)  +  5V[f(x-c)]  (5) 

The  finite-horizon  formulation  of  the  above  problem  is  also 
given,  as  it  will  prove  useful  in  obtaining  some  subsequent  results  and 
illustrations.   The  one-period  horizon  (or  two-period  maxiraiation)  problem 
is  given  by: 


V;,(x)  =  max   M1(c1;x)  ,  (6) 


where 


0  <_c  <  x 


II1(c1;x)  =  u(c1)  +  ouffCx-Cj^)]  . 


Thereafter,  the  (n-1)  period-horizon  problem  is  given  recursively  by 
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v  (x)  *  max   Mn(cn;x)  ,  (7) 

0<c  <x 

—  n— 


where 


M  (c  ;x)  =  u(c  )  +  6V  [f(x-c  )] 
n  n        n      11      n 

Our  object  is  to  find,  for  the  parametric  optimization  in 
equation  (4) ,  the  absolute  maximum  of  M  within  the  given  range  of  values 
of  c,  since  the  principle  of  optimality  does  not  hold  for  local  maxima. 
It  will  be  shown,  by  way  of  a  simple  example,  that  an  interior  maximum 
of  M  may  exist  on  an  interval  of  x  and  not  be  the  optimal  solution,  as 
it  is  dominated  by  a  corner  solution  on  part  of  that  interval.   In  such 
a  case,  the  local  interior  maximum  of  M  does  not  satisfy  the  principal 
of  optimality,  and  thus  does  not  satisfy  equations  (1)  and  (4) .   Sufficient 
conditions  on  u  and  f  which  guarantee  that  this  absolute  maximum  is 
interior,  i.e.,  that  the  maximizer  c*  (for  each  positive  x)  is  not  a 
boundary  solution  of  the  form  c*  =  0  or  c*  =  x,  will  be  given  below. 

Denote  this  absolute  maximizer  by  g(x)  and  the  resulting 
optimal  state  function  by  H(x) ,  i.e.,  H(x)  =  f(x  -*g(x)),  x  >^  0.   Then 
equations  (4)  and  (5)  imply  that  for  any  x  ^  0: 

V(x)  =  u[g(x)]  +  5V[H(x)]  (8) 

From  the  formulation  of  the  problem,  as  given  by  relations 
(1) ,  (2)  and  (3),  the  theorem  of  the  maximum  ([1],  [6]),  the  concavity 
of  the  objective  function  and  the  continuity  of  the  constraints,  it 
follows  that  V  is  a  continuous  function.   Therefore,  M  is  a  continuous 
function  of  c,  and  thus  achieves  its  maximum  on  the  interval  [0,x]  for 
any  x. 
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Now,  in  order  to  characterize  an  interior  solution,  we  must 
study  the  differentiability  properties  of  the  value  function  V.   These 
properties  turn  our  to  be  significant  in  determining  the  properties  of 
the  function  H.   It  was  shown  in  [2]  that  V  has  left  and  right  derivatives 
on  (0,+°°),  and,  moreover,  that  V'(x  )  <_  V'(x  ),  for  all  x  >  0.   The  proof 
of  this  fact  is  the  same  as  that  for  the  differentiability  of  the  value 
function  in  the  classical  case,  and  can  also  be  found  in  [4] . 

We  now  show  that  M  is  dif f erentiable  at  (c*;x),  for  all 
x  >  0  or  in  other  words  that: 

Lemma  3.1:   For  any  x  >  0,  V  is  dif f erentiable  at  H(x) . 


Proof :   Suppose  that  V  is  not  dif f erentiable  at  H(x_) .   Then, 

9M(g(x0)',x  )       3M(g(x0)  +  ,x0) 
>  0  >  " 


3c  3c 


or 


u'[g(xQ)]  -  6V'[H(x0)  ]f'(x0-g(x0))  >  0  >  u'[g(xQ)]  -  5V'[H(x0)"]f(x0-g(x0)) 

Hence  V [H(x  )  ]  >  V [H(xn)  ] ,  a  contradiction,  whence  the  conclusion. 

This  lemma  is  a  very   important  result,  not  only  because  it 
allows  a  rigorous  treatment  of  the  necessary  and  sufficient  conditions 
for  optimality,  but  also  in  view  of  its  direct  relevance  to  the  steady- 
state  analysis,  as  will  be  seen. 

With  this  result  in  hand,  the  first-order  condition  for  the 
maximization  in  (4)  is,  for  any  x  >  0: 

u'[g(x)]  =  oV[H(x)]f'(x-g(x))  .  (9) 

Differentiating  both  sides  of  equation  (8)  yields, 
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V'(x)  =  u?[g(x)]g'(x)  +  6V,[H(x)]f'(x-g(x))(l-g'(x))-/  .   (10) 

Substituting  equation  (9)  into  (10)  yields  the  envelope  result: 

V(x)  =  u'[g(x)]  ,  (11) 

which  implies  that  the  value  of  an  extra  unit  of  capital  is  the  marginal 
utility  of  consumption  derived  from  it. 

Since  equation  (11)  holds  for  one-sided  derivatives  at  every 
value  of  x,  it  is  clear  that  to  a  jump  discontinuity  in  g  (and  thus  in 
H)  corresponds  a  kink  in  V. 

Substituting  equation  (11)  back  into  (9)  yields  the  Euler 
equation 

u'[g(x)]  =  6u,{g[H(x)]}f'(x-g(x))  ,  for  any  x  >  0  .     (12) 

This  equation  will  be  used  repeatedly  in  the  sequel  as  the  generalized 
first-order  condition  for  an  interior  maximum  of  (1) . 

Along  with  equation  (12) ,  any  optimal  path  must  also  satisfy 
the  transversality  condition  (see  [4],  [2])  given  by: 

lim  6  u(c  )(x  -c  )  =  0 
„       t   t  t 

The  existence  of  an  absolute  maximum  is  ensured  by  three 
simple  assumptions  as  shown  in  Lemma  3.2.   The  proof  of  Lemma  3.2  requires 
the  derivation  of  the  finite-horizon  Euler  equation,  which  is  straight- 
forward from  the  formulation  given  by  equations  (6)  and  (7). 

Lemma  3 .2  :   The  Conditions  uf (0)  =  +«,  f (0)  =  0  and  f ' (0)  >  0  are 
sufficient  to  ensure  the  existence  of  an  interior  solution  as  the 
global  maximum  to  the  optimization  problem  described  by  equations  (1) , 
(2)  and  (3). 


trictly  speaking,  we  are  considering  one-sided  derivatives,  which 
taken  to  be  +°°  at  upward  jumps  of  g  and  -°°  at  downward  jumps. 
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Proof :   This  result,  which  is  illustrated  in  Figure  2, follows  by  induc- 
tion on  n.   From 

8M  (c, ;x) 

-^ =  u'(C;L)  -  6u'[f(x-c1)]f'(x-c1)  , 

it  follows  that 

9M  (0;x) 

—^ =  u'(0)  -  5u,[f(x)]f,(x)  =  -Ho  ,  for  x  >  0  . 

3C1 

and 

3M  (x;x) 

—^4 =  u'(x)  -  5u'[f(0)]f '(0)  =  —  ,  for  x  >  0  . 

3C1 

Hence  since  M  is  continuous  in  c  there  exists  an  interior  maximizer  c* 

(0  <  c*  <  x)  for  the  one-period  horizon  problem. 

Assuming  the  result  holds  for  the  (n-1)  period  horizon  problem, 

we  thus  have  0  <  g  (x)  <  x  and  g  (0)  =  0  (and  H  (0)  =  0).   Then,  for  the 

n-th  period  horizon  problem, 


3M  ,  -,  (c  ,  ,  ,x) 

n+1 

=u'(cn+1)  -  6u'(gn[Hn+1(K)]}£'(x-cn+1) 


In  particular, 


and 


3M   (0;x) 

— ^ =  u'(0)  -  5u'{g  [f(x)]}f(x)  =  +«>  ,  for  x  >  0 

3c  n 

n+1 


3M  _,,  (x;x) 


4~ =  u'(x)  -  5u'(0)f'(0)  =  -«  ,  for  x  >  0  . 

n+1 
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So  0  <  c*  <  x,  n  =  2,  3,  ....   Taking  limits  as  n  ■+■   °°  on  both  sides  of 

3Mn+l 
the  equation  for ,  and  using  the  fact  that  V   is  dif f erentiable 

°Cn+l 

at  H  . , (x)  or  equivalently  that  g   is  continuous  at  H  , , (x) ,  for  all  x, 
n+I  n  n+1 

the  conclusion  follows  for  the  infinite-horizon  problem. 


Although  not  necessary,  the  three  conditions,  u? (0)  =  +», 
f(0)  =  0,  f'(0)  >  0  cannot  be  relaxed  in  general  if  strictly  interior 
solutions  are  sought.   In  fact,  if  any  one  of  them  is  omitted,  there 
exists  a  u  and  f  for  which  the  optimal  solutions  will  not  be  an  interior 
one  throughout  [0,°°) .   In  particular,  see  the  example  given  below. 


B.   Second-Order  Conditions 

The  purpose  of  the  introduction  of  convexity  (or  concavity) 
assumptions  in  modern  optimization  theory  is  essentially  two-fold. 
First,  it  allows  the  relaxation  of  smoothness  assumptions.   Second, 
it  transforms  local  extrema  into  global  ones  in  addition  to  doing 
away  with  the  need  for  second-order  conditions. 

In  the  classical  optimal  growth  problem,  the  concavity  of  u  and 
f  implies  that  of  V  (see  [4]),  thus  making  M  a  concave  function  of  c. 
The  optimal  solution  g(x)  is  thus  unique  for  each  x,  and  thus  the  first- 
order  conditions  for  maximizations  are  sufficient  as  well  as  necessary 
[ 4  ] .   Furthermore,  the  concavity  of  V  also  implies  that  the  marginal 
consumption  function  g'(x)  is  between  0  and  1  for  all  x.   This  result 
coincides  with  economic  intuition. 

However,  in  the  nonclassical  case,  with  the  properties  of 
the  production  function  given  by  assumption  P4,  P5  and  P6,  the  optimal 
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solution  g(x)  is  not  unique.   Hence  a  second-order  condition  is  necessary 
to  distinguish  between  maxima  and  minima.   Moreover,  g(x)  may  have 
downward  jump  discontinuities  and  g'(x)  can  be  negative  over  an  interval! 
These  somewhat  surprising  results  will  be  illustrated  below  with  a 
simple  example. 

We  start  by  deriving  a  concise  expression  for  the  second- 
order  condition,  assuming  the  conditions  of  Lemma  3.2  hold. 

Proposition  3.3: 

For  each  x  >  0,  g(x)  is  the  maximizer  in  (1)  if: 

i)   0  <_  g(x)  £  x, 

ii)   g(x)  satisfies  the  first-order  conditions,  and 

iii)   g'(x)  <  1. 

Proof  of  iii) : 

The  second-order  condition  for  the  maximization  in  (4)  is: 


32M(c;x) 


a  2 

3c 


,  Vx  >  0 
c  =  g(x) 


In  other  words,  for  all  x  >  0, 

u"[g(x)]  +  5{V,,[H(x)]f,2(x-g(x))  +  V'[H(x)]fM  (x-g(x))}  <  0*-7   (13) 
Differentiation  of  equation  (9)  yields, 


2/ 

—  Here  V   is  taken  to  mean  a  one-sided  derivative  of  V'  with  the 

jumps  taken  as  in  footnote  1. 
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u"[g(x)]  g'(x)  =  6{V"  [H(x)]f'2(x-g(x))  +V'[H(x)]f"  (x-g(x) ) } (1-g' (x) )  .-' 

(14) 
Substitution  of  equation  (14)  into  (13)  yields 

u-[gcx>]  +  »"|8W ]?■<«)  <  o  ,  V  >0. 

1-g  (x)  x 

This  reduces  to 

1  +  ig'w\  >  °    or   Htt  >  o    or  g'(x>   <  1   • 

1-g  (x)  1-g  (x) 

Since  upward  jumps  violate  the  second  order  condition,  it 

follows  from  the  second-order  condition  that  any  jump  discontinuity 

of  g  must  be  downward;  i.e. ,  such  that  lim  g(x)  >  lim  g(x) ,  where 

xfxQ        x+x 
x~  is  a  jump  point  of  g.   Consequently,  it  can  be  seen  from  equation 

(11)  that  V (xQ)  <  V' (xQ)  at  xQ,  a  jump  point  of  g. 

The  following  property  of  H,  which  plays  a  major  role  in  the  upcom- 
ing stability  analysis,  is  elegantly  proved  in  [2].   However  using 
the  second-order  conditions  it  can  be  shown  quite  simply. 

Corollary  3.4: 

The  function  H  is  strictly  increasing. 

Proof :   H'(x)  =  f ' (x-g(x) ) (1-g' (x) )  >  0,  by  the  second-order  condition. 


3/  t 

—  The  chain  rule. for  one-sided  differentiation  for  any  two  functions 

f  and  g, [f  o  g(x)]1  =  f ' [g(x) ]g' (x)  may  not  hold  if  g'(x)  =  +«> 

and  f'[g(x)]  =  0. 

In  our  case,  with  x  a  jump  ..point  of  g,  if  either  V"[H(x)]  =  0  or 
f"(x-g(x))  =  0,  equation  (14)  may  not  hold. 
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C.   Example 

An  extremely  simple  example  in  a  one-period  horizon  context, 
and  with  the  convex  portion  of  f  only,  is  given  here.   This  example 
serves  as  a  perfect  illustration  of  four  essential  points  of  interest. 
It  shows : 

i)   How  the  absolute  maximum  function  g(x)  may  switch 
from  a  boundary  solution  to  an  interior  solution 
thus  generating  a  downward  jump. 
ii)   That  the  second-order  condition  may  be  necessary, 
iii)   That  the  marginal  consumption  function  g'(x)  may 
be  negative  over  an  interval  of  x. 
iv)   That  a  relative  maximum  of  M  does  not  satisfy  equa- 
tions (1)  and.  (4)  on  a  certain  interval  of  x,  where  it  ■ 
is  dominated  by  a  boundary  solution. 

Consider  the  one-period  horizon  problem  with  u(c)  =  /c, 

3 
c  >  0  and  f(x)  =  x  ,  x  >  0, 


V(x)  =  max   {/c  +  V  (x-c)  } 
0<c<x 


(15) 


Letting  M-(c;x)  ■  /c   +  v(x-c)  ,  it  is  easy  to  see  that 


3M(0;x)  _  ^ 

3c 

and 

3M(x;x)  =  _1_  >  Q 

3c    .  r 
2/x 

All  three  possible  representations  of  M(c;x)  are  depicted  in  Figure  3. 

The  first  order  condition  for  the  maximization  in  (15) ,  for  an  interior 

solution  is, 
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1    3  , 


2/c 
which  reduces  to  the  quadratic  equation  in  c 


9c2  -  9xc  +  1  =  0  (16) 


The  two  solutions  to  this  equation  are  given  by 

g,(x)  =  \   (3x  +V9x2-4)  and  g  (x)  =  \   (3x  -  /9x2-4)  for  x  :■  2/3  .     (17) 

+"  6  ~  6 

The  marginal  consumption  functions  are  given  by: 

g|(x)  =  |(3  +   9X  )   and  gl(x)  =  -|(3  -  -  9x  )  ,  for  x  >  2/3  . 
V9x2-A  v  9x2-4 


If 


0  <_  x  <  2/3,  the  values  g  and  g  are  imaginary  hence  no  interior 


solution  exists,  and  M(c;x)  is  maximized  by  g  (x)  =  x,  where  the  sub- 
script c  stands  for  a  corner  solution.   It  can  be  verified  that  for 
all  x  j>  2/3,  0  <  g_(x)  <_  g,(x)  <  x,  i.e.,  both  solutions  are  interior 
and  feasible.   Moreover,  g'(x)  >  1  >  0  >  g_^(x). 

Invoking  the  second-order  condition,  it  follows  that  g  (x)  is 
an  interior  maximum,  while  g  (x)  is  an  interior  minimum  of  M(c;x),  for 
x  :  2/3.   Moreover  the  implications  of  the  second  order  conditions  are 
consistent  with  Figure  3. 

Note  that  the  interior  maximum  g_(x)  has  the  property  that 
marginal  consumption  is  always  negative,  i.e.,  optimal"  consumption  is 
always  declining,  as  a  function  of  output. 

The  usefulness  of  convexity  assumptions,  from  a  purely  mathe- 
matrical  standpoint,  is  mentioned  in  the  introduction  of  this  section. 
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While  the  relevance  of  convexity  to  recent  economic  theory  is  obvious, 
its  impact  on  intuitive  economic  thinking  is  not  easily  isolated. 
Thus,  if  declining  optimal  consumption  seems  counter-intuitive,  it  is 
only  because  economic  intuition  is  implicitly  conditioned  by  convexity 
assumptions,  as  found  in  the  vast  literature  on  classical  optimal 

♦ 

growth. 

Notice  also  that  since  V"(x)  =  u" [g(x) ]g' (x) ,  the  value  func- 
tion is  convex  on  the  interval  [Xj-H30)  while  it  is  concave  on  the  inter- 
val [0,x]. 

It  comes  as  no  surprise  that  this  problem  has  a  corner  solu- 
tion on  some  interval,  since  in  view  of  Lemma  3.2,  the  assumption  f'(0)  ^  0 
is  violated.   This  interval  will  be  calculated  below.   However,  first 
we  consider  the  value  function.   To  the  corner  solution  g  (x)  =  x 
corresponds  a  value  function, 

V  (x)  =  vx"  , 
c 

and  to  the  interior  solution  g  (x)  given  in  (17)  corresponds  the  value 


function  V,.  (x)  , 


'(x)  =/t(3x  -  V9x2-4)  +  [^(3x  +  >/9x2-4)]3/2 


It  is  easy  to  check  that  at  x  =  2/3, 


v!>  =  I  >  v!>  =  f /! 


This  implies  that  the  corner  solution  dominates  the  interior  solution 
at  x  =  2/3.   It  can,  in  fact,  be  shown  that  there  exists  a  unique 
x  with  the  property  that 
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V  (x)  =  VT(x)   and  V  (x)  J  VT(x)   if  x  5  x  . 

C        1  C        1  ■* 

Hence,  the  overall  optimal  consumption  policy,  which  is  the 
absolute  maximum  of  M,  is  given  by: 


g(x)  =  < 


x  ,   if  x  <  x 


/  2 
g-[3x  -  79x  -4]  ,   if  x  >_  x  , 


where  x  is   the  solution  of    ^x  =  J~(3x  -  v'9x2-4)   +    [-|  (3x  +  n/9x2-4)]3      . 

b  b 

It  is  readily  seen  that  g  has  a  jump  discontinuity  at  x  where 

it  is  double-valued,  and  where  V  is  continuous  but  not  dif f erentiable 
(Figure  4) . 

Consumption  in  the  second  period  is  given  by 


H(x)  =< 


r°. 


if  x  <  x 


{^[3x  +  /9x2-4]}3  ,   if  x  :  x 
.  b  — 


Notice  that  although  u'(0)  =  +<»,  the  optimal  consumption  in  the  second 
period  is  zero. 

It  is  only  in  the  two-period  case  that  one  may  hope  to  compute 
(nonlinear)  solutions.   However,  the  distinctive  features  illustrated  in 
the  above  example  can  be  shown  to  extend  to  problems  with  an  arbitrary 
horizon. 

4.   Steady  State  Analysis 

The  questions  of  existence,  uniqueness  and  stability  of  steady 
state  equilibria  of  the  optimal  paths  are  examined  in  light  of  the  results 
obtained  in  the  previous  section.   Before  doing  this  some  more  preliminary 
results  will  be  presented. 
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In  the  classical  optimal  growth  model,  it  is  straightforward 
to  show  that  the  continuity  of  the  optimal  state  function  H  and  the 
assumption  of  the  Inada  conditions  on  f  (i.e.,  f'(0)  =  +«>  and  f '  (°°)  =  0) 
are  sufficient  to  guarantee  the  existence,  uniqueness  and  global  stability 
of  a  steady  state  equilibrium  level  of  capital.   Thus,  all  optimal  paths, 
regardless  of  where  they  started,  converge  to  this  unique  level.   How- 
ever, with  the  nonclassical  production  function  as  described  in  P4-P6, 
there  are  no  such  simple  results  on  the  properties  of  the  steady  state 
or  the  stability  properties  of  the  optimal  paths.   It  will  be  seen  that 
the  stability  and  steady  state  properties  depend  on  the  rate  of 
interest  (or  the  discount  factor  5)  and  the  initial  marginal  product  (f'(0)) 
Since  only  interior  solutions  are  of  interest  ,  in  the  following  analysis 
the  conditions  u'(0)  =  +»,  f(0)  =  0  and  f'(0)  i   0  are  assumed 
throughout. 

Let  us  first  formally  define  a  steady  state  equilibrium. 

Definition  4.1: 

A  steady  state  equilibrium  x  >  0  is  a  fixed  point  of  the  func- 
tion H,  i.e.,  x  =  H(x) . 

In  other  words,  at  x, 

x    =  x  =  x  ,  for  all  t  . 

The  following  lemma  provides  a  convenient  characterization  of 
such  points. 

Lemma  4.2:   A  necessary  condition  for  x  to  be  a  steady  state  equilibrium 
is  that  6f'(x-g(x))  =  1. 
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Proof :   This  follows  directly  upon  substitution  of  x  =  H(x)  in  equa- 
tion (12). 

Notice  that  as  in  the  classical  case  the  location  of  the  steady 
state  equilibria  depend  only  on  the  function  f. 

From  the  properties  of  f  it  is  clear  (see  Figure  1)  that  the 
equation  5f'(y)  =  1  has  either  zero,  one  or  two  solutions.   To  each 
such  solution  y  corresponds  at  most  one  x  such  that  x  -  g(x)  =  y.   This 
follows  from  the  second-order  conditions,  since  h(x)  Ex-  g(x)  is  a 
strictly  increasing,  and  thus  infective,  function  of  x,  possibly  with 
upward  jump  discontinuities. 

In  order  to  see  that  the  equation  6f ' (x  -  g(x))  =  1  is  not 
sufficient  to  guarantee  that  x  is  steady  state  equilibrium  (for  which 
H(x)  =  x)  ,  consider  a  production  function  f  such  that  f(x)  <_   x  for  all 
x  but  f'(x,)  >  1/5.   In  this  case,  there  will  be  two  solutions  to  the 
equation  6f'(x  -  g  (x) )  =  1,  none  of  which  will  actually  yield  a  steady 
state  equilibrium  since  H(x)  <  f  (x)  <_  x,  for  all  x. 

The  following  lemma  provides  information  on  the  behavior  of 
the  H  function  near  0. 

Lemma  4.3:   For  x  sufficiently  small  H(x)  >  x  if  and  only  if  <5f '  (0)  >_  1. 

Proof:   Consider  the  Euler  equation,  (12),  in  the  form: 

u"{g[H(xj]}  -  »'<*-g<*»    ■    f°rallx>0. 

For  sufficiently  small  x,  H(x)  >  x  implies  that  g[H(x)]  >  g(x) 
since,  g  being  an  interior  solution,  g(0)  =  0  and  g  must  be  continuous 
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and  increasing  at  zero.   Thus  6f'(x-g(x))  >  1.   Taking  the  limit  as 
x  +  0,  it  follows  that  5f'(0)  _>  1.   For  similar  reasons,  H(x)  <  x  for 
small  enough  x  implies  that  5f'(x-g(x))  <  1.   Taking  the  limit  as  x  +  0 
and  keeping  in  mind  the  fact  that  h(x)  =  x  -  g(x)  is  an  increasing  func- 
tion of  x  and  that  f  is  an  increasing  function  of  x,  it  follows  that 
6f*(0)  <  1. 

Before  considering  the  question  of  stability  of  a  given  steady 
state  equilibrium  x,  we  need  the  following  fact: 

* 
Corollary  4. A  (to  Lemma  3.1):  V  is  dif f erentiable  at  any  steady  state  equilibrium  x, 

Proof:   ¥x  >  0,  V  is  dif ferentiable  at  H(x) ,  and  x  =  H(x) . 
Also, 

Lemma  4.5:   A  steady-state  equilibrium  x  is  stable  if  and  only  if 
g'(x)  >  1-6. 

Proof :   Clearly,  x  is  stable  if  and  only  if  H'(x)  <  1,  so  that 
H'(x)  =  f'(x-g(x))(l-g'(x))  <  1  of  i(l-g'(x))  <  1. 

Lemma  4.6:   A  steady-state  equilibrium  x  is  locally  stable  if  and  only 
if.  x  -  g(x)  >  x  . 

Proof :   Differentiation  of  the  Euler  equation  (12)  at  x  yields  (in  view  of 
Corollary  3.4) : 
u"[g(x)]g'(x)  =  6{uM  [g(x)]g'(x)f,2(x-g(x))  +u'[g(x)]  fM(x~-g(x))}(l-g'(x)) 

which  can  be  rewritten,  since  6f'(x-g(x))  =  1,  as: 
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u"te(*)|gr(*)  =  t  u"[g(x)]g'(x)  +5u»[g(x)]  fM(x-g(x))  .    (18) 
l-g'(x)       6 

Clearly  if  f"(x-g(x))  >  0, 


^MEU^El^   u"[g(x)]g.(x) 

l-g'(x)       6 
or 

g*(x)[5  -  1  +  g'(x)]  <  0  . 

This  implies  either  g'(x)  <  0  and  g'(x)  >  1  -  6,  which  is  a  contradic- 
tion, or  g'(x)  >  0  and 

g'(x)  <  1  -  5  . 

It  can  be  shown  that  for  any  x  such  that  x  -  g(x)  >  x  ,  in 
view  of  the  concavity  of  f ,  the  desirable  results  from  the  classical 
one-sector  optimal-growth  case  hold.   In  particular,  V  is  concave  and 
g  (and  thus  H)  are  continuous  in  that  region,  with  0  <  g'(x)  <  1.   Thus, 
if  f"(x-g(x))  <  0,  equation  (18)  yields  g ' ( x )  (6  -  1  +  g * (x ) )  >  0.   Since 
g'(x)  >  0,  it  follows  that  g'(x)  <  1  -  6. 

In  other  words,  this  lemma  implies  that  any  fixed  point  x 
of  H,  is  stable  if  x  -  g(x)  is  on  the  concave  part  of  f  (i.e., 
x  -  g(x)  >  xT) ,  and  unstable  if  x  -  g(x)  is  on  the  convex  part  of 
f  (i.e. ,  x  -  g(x)  <  xx) . 

Geometrically,  one  can  think  of  a  fixed  point  x  of  H  as  being 
stable  if  H  crosses  the  45°  line  from  above  to  below,  and  unstable  if  H 
crosses  the  45°  line  from  below  to  above. 

We  are  now  in  a  position  to  put  together  all  the  preliminary 
results  and  use  them  to  study  the  existence,  uniqueness  and  stability 
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of  steady-state  equilibria.   However,  as  is  clear  from  Lemma  4.3,  two 
separate  cases,  depending  on  the  level  of  discounting,  must  be  considered 

I.   Mild  Discounting;   <5f'(0)  _>  1: 

In  this  case  the  following  general  result  holds. 


Lemma  4.7:   There  exists  a  unique  steady-state  equilibrium  x  >  xT  which 

i . j  

is  globally  stable. 


Proof :   H  must  be  a  continuous  function  in  this  case.   Otherwise,  if 
xn  is  a  jump  discontinuity  of  H,  consider  the  following  possible  cases 
(refer  to  Figure  5) : 


i)   x„  <  H(xn) :   then  there  exists  y  <  x_  such  that  H(y)'=  x~,  and 

thus  V  has  a  kink  at  H(y)  for  some  y,  which  is  impossible  since 

V  is  dif f erentiable  at  H. 

ii)   xn  >  H(x~) :   then  the  only  way  not  to  have  a  point  y  such  that 

H(y)  =  x~  is  to  have  another  jump  discontinuity  of  H,  say  at  x..  , 

such  that  xn  is  between  lim  H(x)  and  lim  H(x) ,  and  so  on.   How- 

x+x  xix1 

ever,  since  beyond  a  certain  point,  H  is  a  continuous  function 

(as  in  the  classical  case),  this  sequence  of  jumps  cannot  take 
place. 

From  Lemma  4.3,  H(x)  is  above  x  near  0,  which  together  with 
continuity,  and  the  fact  that  the  equation  5f'(x-g(x))  =  1  has  exactly  one 
solution  in  this  case,  implies  the  conclusion. 

Note  that  in  this  case,  from  Lemma  4.5,  x  must  be  on  the  con- 
cave part  of  f,  i.e.,  x  >  x, .   Thus,  any  optimal  path  converges  to  x 
irrespective  of  the  initial  capital  stock. 


-24- 

II.   Strong  Discounting:   6f'(0)  <  1 

The  only  definite  conclusion  in  this  case  is  that  if  f(x)  <  x 
for  all  x,  then  H  is  a  continuous  function  (the  proof  of  this  is  already- 
given  in  (I  ii))  such  that  H(x)  <  f (x)  <_  x,  and  0  is  the  only  (globally 
stable)  steady-state  equilibrium.   Hence,  since  all  optimal  paths  con- 
verge to  0,  extinction  of  capital  is  optimal.   However,  because  of  the 
infinite  marginal  utility  at  0,  actual  depletion  of  the  capital  stock 

never  occurs. 

f  (x) 

For  production  functions  with  max  >  1,  one  cannot  determine 

x 

a  priori  whether  H  will  have  steady-state  equilibria  (one  or  two  are  possi- 
ble) ,  or  if  H(x)  <  x  as  described  above.   If  H  is  ever  above  the  45°  line, 
two  cases  are  possible: 

Case  1:   If  H  has  only  one  steady-state  equilibrium  x,  it  readily  follows 

from  the  properties  of  f  (see  Figure  1)  that  x  -  g(x)  >  x  ,  and  thus 

x  is  in  the  concave  portion  of  f.   Moreover,  since  H  is  below  the  45° 

line  initially,  there  exists  a  point  x,  with  0  <  x  <  x,  where  H  has  an 

upward  jump  that  skips  the  45°  line,  i.e.,  such  that  lim  H(x)  <  x  <  lim  H(x) 

xtx  xix 

Thus  all  optimal  paths  with  initial  capital  stock  below  x  converge  to  the 

origin,  and  all  those  with  initial  capital  stock  above  x  converge  to  x. 

Furthermore,  if  the  initial  output  is  x,  then  two  optimal  paths  are 

possible,  both  yielding  the  same  value  V(x) ,  such  that  the  one  with  higher 

initial  consumption  converges  to  the  origin,  and  the  other  one  to  x. 

• 

In  this  case,  it  can  easily  be  seen  (referring  to  Figure  6)  that 
there  exists  no  y  with  H(y)  =  x,  and  thus  no  violation  of  the  fact 
that  V  is  differentiable  at  H(x) ,  for  all  x,  occurs  at  the  jump  dis- 
continuity x  of  H  (and  g) . 
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Also,  Che  equation  5f'(y)  =  1  has  two  solutions  in  this  case, 

say  y  and  y.  with  y  <  y „.      However,  the  equation  h(x)  =  x  -  g(x)  =  y. , 

i  =  1,  2,  does  not  have  a  solution  x.  if  y^=  y.  because  lim  h(x)  <  y. 

xtx 
<  lim  h(x).   In  other  words,  the  horizontal  line  x  =  y,  does  not 

x+x 
intersect  the  graph  of  h(x)  due  to  the  upward  jump  of  h(x)  at  x. 

On  the  other  hand,  x  =  H(x)  is  the  solution  to  x  -  g(x)  =  y_. 

Nothing  rules  out  the  possibility  that  H  may  have  several 
jump  points,  in  which  case  all  of  them  must  be  confined  to  the  open  inter- 
val (0,x).   Such  a  jump,  say  at  point  x,  must  be  such  that  there  is  no 
y  with  H(y_)  =  x,  for  otherwise  it  would  violate  Lemma  3.1.   Geometrically, 
this  means  that  the  horizontal  line  at  x  must  not  cross  the  graph 
of  H,  as  illustrated  in  Figure  6.   It  can  easily  be  seen,  however,  that 
extra  jump  points  confined  to  the  interval  (0,x)  do  not  change  the 
behavior  of  optimal  paths  in  any  way  as  far  as  convergence  is  concerned. 
Case  2:   It  is  also  possible  that  H  has  two  steady-state  equilibria 
x.  and  x~  (say  with  x  <  x~)  ,  in  which  case,  according  to  Lemma  4.6, 
x1  -  g(x..)  <  x  and  x  is  an  unstable  fixed  point  of  H,  while 
x„  -  g(x2)  >  xT  and  x„  is  a  stable  fixed  point  of  H.   In  this  case 
the  equation  6f'(y)  =  1  has  two  solutions  y  and  y~ ,  each  of  which  has 
a  corresponding  solution  x.  and  x~  from  the  equation  x  -  g(x)  =  y., 
i  =  1,  2.   Although  it  is  clear  that  x9  is  in  the  concave  region  of  f 
(i.e.,  x~  >  x  ),  nothing  can  be  said  in  general  about  the  position  of 
x„  relative  to  that  of  xT  (both  possibilities  may  occur) . 

Both  cases  actually  yield  the  same  economic  interpretation: 
there  exists  a  threshold  level  of  capital  (x  in  Case  1  and  x,  in 
Case  2)  below  which  it  is  not  optimal  to  start  accumulating  in  view  of 
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the  extremely  low  marginal  product  of  capital,  and  above  which  it 
pays  to  accumulate  capital  up  to  the  level  of  the  stable  steady-state 
equilibrium. 

If  the  initial  capital  stock  is  at  this  threshold  level, 
optimality  dictates  remaining  indefinitely  at  that  level  in  Case  2, 
and  a  choice  between  accumulation  of  capital  up  to  x  and  depletion 
of  capital  without  ever  reaching  zero  because  of  the  three  conditions 
of  Lemma  3.2  in  Case  1. 

Example: 

This  example  will  serve  to  illustrate  the  following  possibilities 

i)   the  existence  of  an  unstable  steady-state  equilibrium  if  6ff(0)  <  1. 
ii)   the  existence  of  an  interior  optimal  solution  even  with  a  strictly 
convex  production  function,  for  appropriate  values  of  the  discount 
factor,  5. 

The  limiting  case  of  a  linear  production  function  is  studied 
in  [  4 ] .   It  was  shown  there  that  when  coupled  with  an  isoelastic  utility 
function,  i.e.,  u(c)  =  In  c  or  u(c)  =  c  ,  0  <  a  <  1,  this  production 
function  yields  linear  consumption  policies.   Moreover,  the  only  other 
choice  of  f  and  u  which  produces  linear  policies  is  u(c)  ■  In  c  and 

f(x)  =  x6,  0  <  S  <  1. 

g 
It  can  be  shown  that  if  u(c)  =  In  c  and  f(x)  =  x  ,  S  >  1 

(i.e.,  only  the  convex  portion  of  f  in  the  nonclassical  case),  the 

optimal  consumption  policy  is  linear,  provided  the  discount  rate  is 

small  enough.   This  is  true  independent  of  the  length  of  the  horizon. 
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If  the  discount  rate  is  large  the  optimal  policy  g  is  linear  for  all 

n 

n  but  the  infinite  horizon  optimal  policy  g  does  not  exist. 
Specifically,  consider: 

2 
u(c)  =  In  c  ,  c  >  0  and  f(x)  =  x   ,  x  >  0  . 

The  Euler  equation  reduces  to: 


1  u   26(x-g(x))     ¥x  >  Q 


8(X)   g[(x-g(x))2] 


(19) 


4/ 
Substitution  g(x)  =  Ax—  in  the  above  equation  and  solving  for  A,  yields 

g(x)  =  (1-  25)x  if  5  <  1/2.   If  6  >  1/2,  no  solution  exists  for  the 

infinite  horizon  problem.   In  the  infinite  horizon  problem  with  5  >_  -r- 

optimality  requires  that  the  output  be  built  up  indefinitely  with  no 

consumption.   This  is  clearly  the  case  since  only  if  the  future  utilities 

are  strongly  discounted  will  it  be  optimal,  with  the  increasing  marginal 

product  of  f,  to  consume  a  positive  quantity  in  each  period  instead  of 

letting  all  of  the  output  grow  indefinitely. 

Thus,  if  6  <  1/2,  the  optimal  stock  function  H  is  (see  Figure  7) 

H(x)  =  [x  -  (l-26)x]2  =  (26x)2  =  462x2  . 

-    1  ' 

H  has  a  fixed  point  x  =  — -,  which  is  an  unstable  steady-state  equilibrium. 

462 
The  transversality  condition  is  satisfied  by  this  solution 

since  the  exponential  decay  of  6   overcomes  the  parabolic  increase 

in  H. 


4/ 

—One  must  actually  prove  that  there  are  no  other  (nonlinear)  solutions 

to  equation  (19) .   This  could  be  easily  done  by  considering  the  finite- 
horizon  version  of  this  problem,  from  which  it  will  follow  that 

g  =  lim  g   is  unique  (with  g   =  A  x) . 
°n       M         &n    n 
n 
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Moreover,  g(x)  =  (1  -  2<S)x  is  an  interior  solution,  and  the 
second-order  condition  is  satisfied. 

Notice  that  by  inserting  a  concave  portion  to  f  (in  a  twice 
continuous  dif f erentiable  manner)  far  enough  to  the  right,  one  will 
have  a  valid  nonclassical  optimal  growth  problem  with  one  unstable 
steady-state  equilibrium  and  a  stable  one. 
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Graph  of  M(c;x)  for  a  given  x 
(with  u'(0)  =  +»,  f(0)  =  0,  f'(0)  r   0) 
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Figure  4 
The  Optimal  Consumption  Function 
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Figure  6 
H  With  One  Fixed  Point  x 
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